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DIGITAL DATA DETECTION AND SYNCHRONIZATION 


I. INTRODUCTION 

A. Telemetry Communication Links 

The basic function of a communication link, such as 
that illustrated in functional block form in Figure 1, is 
tQ provide the distant destination or user with the infor 
mation content of a data source in a form, and subject to 
a fidelity criterion, that satisfies the user. In telem- 
etry the information originates in a variety of physical 
forms, such as mechanical movement, a temperature change, 
the occurrence of an event, a stored television image, 
etc. The data source usually originates the message in a 
nonelectrical form so that a strain gauge or temperature 
sensor or other form of transducer is reguired to produce 
an electrical waveform whose instantaneous values are a 
calibrated representation of the original source. This 
electrical waveform is known as an analog baseband waveform 
In a typical digital space communication link the in- 
formation to be transmitted is obtained from several con- 
tinuous time varying data sources. The analog data wave- 
forms are sampled periodically and each sample is converted 
into a sequence of binary bits called a binary data word 
[1, Chapter 13. After a predetermined number of data words 
has been encoded, a data word or string of words with a 
known code is inserted into the data stream. The known 
code is called a word sync or frame sync (synchronization, 
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synchronizing) pattern, and is inserted so that the in- 
coming sequence of binary waveforms can be divided into 
the proper words when the data is processed at the receiv- 
er. Each block of data plus the known' code is referred to 
as a data frame. The stream of binary bits that results 
from this process is called the analog baseband binary data. 

The baseband binary data is used to modulate a radio 
frequency carrier and is transmitted to a receiver through 
a channel which may perturb the signal through the. addition 
of noise, fading, multipath effects of intersymbol inter- 
ference due to dispersion. At the receiver the incoming 
radio frequency signal is demodulated or converted back to 
the baseband sequence. The received baseband sequence, 
corrupted by amplitude and phase perturbations due to the 
transmission channel, is what the data detector must use 
to' construct an estimate of the original source output. 

B. Telemetry Receiver Performance 

Two alternative methods are available for recording 
the received signals: recording either the receiver inter- 

mediate frequency (IF) section output or the detector out- 
put. The latter is the most common method, for reasons of 
economy and convenience. Some information is irretriev- 
ably lost by this method, but in most cases this is not a 
serious problem. 

In occasional special cases, such as the false-lock 
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problem, when the receiver is locked on a strong spectral 
component in a sideband, rather than the carrier frequency, 
it could be beneficial to have both of the above signals 
recorded. Some insight, into the false-lock problem and 
other receiver anomalies which produce unusual analog data 
output waveforms has been provided by the baseband receiver 
simulation (BBRS) computer program dealt with at length in 
an 4 earlier report (2 3. 

Two receiver effects are of primary importance in 
synchronization studies: IF filtering and carrier track- 

ing effects. IF filtering results inevitably in some 
information loss, but it is necessary in order to remove 
adjacent channel interference, and it has been done on 
the existing-data . Carrier tracking is done with the 
phase-locked loop in the receiver IF and converter stages. 

It produces a low-frequency additive noise on the detector 
output, and it also produces acquisition, loss-of lock, 
and cycle slipping effects. The factors affecting carrier 
tracking performance are additive noise, carrier phase 
shifts due to doppler shift, antenna tracking effects, 
small amounts of multipath propagation, and loop filter 
characteristics. Approximate analyses have been performed 
by other investigators for acquisition of an offset fre- 
quency signal, a situation typical of satellite acquisition. 
Stiffler [1, p. 140] quotes 

_ _ 1 + 4; 2 (Af) 2 

Af 4? 4c D 3 


secs . 



as the approximate lock-up time with a frequency offset 
and a second order loop. For the commonly used £ ~ 2 

this gives 



(Af) 2 


If this gives an unacceptably long lock-up time, either 
a larger loop bandwidth may be used or the starting 
frequency may be dithered until lock-up occurs. Dithering 


is effective if [1, p. 142] 


AF > 


4 

7T 




1 + 4 C' 



Typical initial doppler shifts are less than 6Khz., and 
loop bandwidths are noticeably smaller than this value. 

Bit sync acquisition is not possible until carrier sync 
is acquired, and this establishes an estimate of the 
minimum signal-to-noise ratio in which bit synchronizer 
performance is of interest. Typically the carrier track- 
ing loop will continue to track satisfactorily at baseband 
signal to noise ratios below the bit synchronizer perfor- 
mance threshold. 

For split-phase data, low frequency noise added to 
the analog output does not significantly affect synchroni- 
zation, since the data itself contains no low-frequency 
components. Interest in carrier tracking performance is 
therefore restricted to acquisition, loss-of-lock, and 



cycle slipping problems. Loss-of-lock occurs when the 
RMS phase error becomes excessive. Its threshold is 
higher than the cycle slipping threshold, and it is 
followed by a reacquisition phase. 

Cycle slipping occurs at a rate determined by the 
bandwidth and the signal-to-noise ratio of the loop. 

The rate is exponentially small at high signal-to-noise 
ratios. The effect of a cycle slip is shown in the 
following two figures. 



Fig. 2. Effect of Cycle Slipping on 
Phase Detector Outputs 

The effects can be described as follows? 

1. Analog signal amplitude drops to zero. 
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2 . Analog signal output reverses, each bit is in error 
but signal is synchronizable . 

3. Analog signal output drops to zero. 

4. Conditions return to normal. In general, loss of 
lock in the synchronizer will not occur during this 
sequence if its loop equivalent bandwidth is equal 
to or less that of the carrier tracking loop. 


II. BIT DETECTION 
A. Classical Results 

In a practical system the recorded signal is affected 
both by the transmitter bandlimiting filter and by receiv- 
er IF filtering. For analyses, however, the assumption of 
a square signal waveform plus additive white Gaussian 
noise allows the use of many classical results and permits 
the description and evaluation of the practical system in 
terms of the ideal model. 

It is well known that if the epoch and duration of 
each symbol are known at the receiver the problem of 
detection of human signals in additive Gaussian noise has 
its solution in the matched filter or correlator receiver 
[see, for example, 3, Chapter 4]. The probability of bit 
error given perfect synchronization is 


where E 


P{e) = Q(/2E7N" 0 ) / 


T 

f s 2 (t) dt , 


the signal energy, N q is the one- 


0 
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sided PSD and Q(X) is defined by 

OO ^ 

Q(X) = — — ( e * st dt . 

^ X 

This is the minimum error probability for any given system. 

With a synchronization error eT the probability of 
error becomes 

P(e,£) = jQ /P<1 - f e (e)) + ^0 /W (1 " f o U)) ' 

L o J L 0 

T 

where (1 - f (e)) = f I s (t) [s (t - eT) + s (t + T - sT)]dt 
e t 

0 

T 

. 1 f 

for s > 0, and (1 - f Q (e)) - ^ s(t)[s(t - eT) 

0 

- s (t + T - eT) ] dt . 

The value of P(e,e) given by this relationship is based 
on equiprobable and independent adjacent bits. The prob- 
ability of error for a given synchronization error 
distribution P, (e) is 

<J> 

H 

P g (e) = P(e,e)P^{e) ds . 

This expression can be used to evaluate the effect of 
synchronizer performance on error probability. A useful 
normalized version of’ timing error is given by 



A 


Var (e) 

2E/N“ * 

It can be shown for square split-phase signals, that the 
signal power degradation is approximated by (1 + 16 A) 
in power. The factor A can be related to synchronizer 
loop bandwidth X bit period X synchronizer performance 
factor. For example, for a common type of early-late gate 
6B 

A is given by — where is the bit rate, is the 

L 

tracking loop bandwidth and A is the window width in 
fractions of a bit. This approximation is good for high 
signal-to-noise ratio and weaker for low SNR. 

B. Decision— Directed Detector for Overlapping. Symbols 

When a binary data stream is received over a prac- 
tical communication system errors in bit detection may be 
caused by intersymbol interference. This channel-induced 
distortion is due to the fact that, because the system is 
narrow band, each symbol may overlap with symbols in the 
preceding and following intervals. The amount of dis- 
tortion depends on the symbol sequence, symbol duration, 
and the channel bandwidth. 

Various methods for correcting the bit decision in 
the presence of intersymbol interference have been con- 
sidered. Aaron and Tufts [4] suggested a method based on 
the use of tapped delay lines to match the channel. They 



account for the intersymbol interference by finding the 
optimum tap positions and gain coefficients for the gi\en 
channel. Helstrom [5] suggested a different method. He 
suggested a system that uses the last three bits received 
for making a decision. He considers all eight possible 
bit configurations by looking at three at a time, and then 
he uses the known channel characteristics to outline the 
design of seven different filters. A decision system is 
then used to choose the filter with the largest output as 
the received PCM signal. Both Aaron's and Helstrom’ s 
methods have a serious disadvantage in the fact that the 
design procedure of these matched filters is very compli- 
cated for any specified channel. Three suggested systems 
for making a decision in the presence of intersymbol 
interference and Gaussian noise are presented by 
Thumim [6] which have the advantage that the parameters 
can be easily changed to adjust the changes in the channel 

As part of the research under this grant, Wang [7] 
has developed the model for a new decision— directed detec- 
tor for overlapping symbols. Analytical results and com- 
puter simulation results are presented as curves of prob- 
ability of error versus signal-to-noise ratio. 

Basically, two steps are involved in his approach. 
First, the symbol most likely received is determined as a 
primary decision. Then, this decision is used to direct 
the detection process to obtain a better estimate of the 
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symbol which will yield less probability of error. For 
overlapping signals, the DD technique can be roughly 
summarized in Figure 4.1. The post- bit detector consists 
of an ordinary matched filter and a sampler. The input 
signals. are processed serially, one after the other, and 
the output is the primary detected value, a . The 
function of the block "SHAPE" is to maintain a constant 
level until the next sampling instant. The output is then 
used to subtract the overlapping tail resulting from the 
next bit. With the subtraction of the overlapping head 
from- the preceding bit, a present-bit detector is followed 
to find the final decision. The overlapping head and tail 
are illustrated in Figure 4.2. 

Since both detectors in Figure 4.1 perform the same 

« 

function, they can be placed in the front as a detector. 
The modified structure, for the DD detector is shown in 
Figure 4.3. Here the decision devices are replaced by two 
hard limiters. The constants K 2 and K 3 will be introduced 
in the following section. 

1„ Mathematical Derivation 

The binary communication system under consideration 
consists of two symbols, (t) and — (t) , defined in 
Figure 4.2. The received signal is 

m 

y (t ) = Y a, S (t - k) + n (t) 
k=i k p 


(4.1) 















The matched filter has an impulse response 


h (t) = S (1 - t) 

Thus the output of the matched filter is 

z (t) = y (t) * h (t) 
m 

= y a. S (t - k) * S (1 - t) + n (t) * S (1 
k=i k p p ■ p 

At the sampling instant t = i, 

m 

2(i) = £ a S (i - k) * S (1 - i) + n(i) * S (1 - i) 
k=l . p p p 

(4.3) 

Due to the overlapping situation, z (i) can be further 
written as 

z(i) » K 2 a,. + K-j_ a^ + + K 4 (4.4) 

where and K-, are the areas when dealing with overlap of 
the ith bit with the (i-l)th bit and with the (i+l)th bit, 
respectively. is the area when the ith bit convolves 

with itself. is the noise coefficient to be defined 

later. These constants are functions of 0, and are requir- 
ed in the simulation program. The calculation of , 

and proceeds as follows. 


- t) 

(4.2) 
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k+l+a 

K 2 = j s p (t - k)s p (t - k + 1) dt 
k-a 


1+a 

| (1/2 + t/2a) (1/2 - t/2a) dt - a/3. (4.5) 

-a 


K 


1 


1+a 

S 2 (t) dt = a/3 + (1 - 2a) + a/3 
P 

-a 


= 1 - 2 a/3 , and 
K 3 = k 2 - a/3 . 


(4.6) 

(4.7) 


To find , we consider the root mean square of the 
correlator output when the signal is correlated with noise. 
That is 


E 


1+a 

■ 

S (t)n(t) 

i P 

-a 


dt 


2 


1+a 
c f 


S (t., ) S (t 0 ) E n (t.. ) n (t 0 ) 

p 1 P Z -L 


dt l dt 2 


= B 


1+a 

f 


-a 


S (t) dt 
P 


- B ( 1 - 2a/3 ) 


(4.8) 


Where B is taken as the reciprocal of the input signal-to- 
noise ratio in the simulation program. The noise, coeffi- 
cient is then - /I - 2 a/3, 
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2. Simulation Program 

In general, the desired output is a graph of P £ versus 
SNR with the overlapping parameter a as a parameter. In 
order to examine how much improvement can be achieved by 
the DD technique, two error probabilities are tabulated in 
parallel. That is, for each bit, a primary decision by 
non-decision-directed measurement is made. At the end of 
m 4 bits , the probability of error of the primary decision 
is computed. Then the final decision on each bit using 
the DD measurement is found. 

In the simulation program 500 bits are generated at 
random and used as input to the DD detector. The proba- 
bility of error is approximated by the ratio of the total 
number of erroneous bits to the total number of input bits. 
The resultant error counts for several values of a are 
shown on succeeding pages. 
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3. Analytical Results 

In this section, calculation of P E for the DD detector 
is considered. The block diagram of a DD detector is 
redrawn in Figure 4.6. 



Fig. 4.6. Block diagram of the DD detector 
The output of the matched filter and sampler is 


m i = K 2 a i-l + K 1 a i + K 3 a i+l + K 4 n i 


(4.9) 


where K. = 1 - (2/3) a 

r \ 

k 2 - k 3 = (1/3) a , and 
K 4 - /l - (2/3“)"a . 

Because of the overlapping situation, three symbols 
are involved in determining the probability of bit error 
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of the primacy detection. Let A - a j_ + l 

eight possible combinations of the sequence are tabulated 
in Table 4.3. The ? E of the primary detection is 

P = p{m. < 0 I a. = l) P{ a . = l} 

1*1 -L 

+ p{m . > 0 I a. = -ll P{ a . = -l) (4.10) 

i I i u 

Table 4.3 Eight possible sequences and mean 
values for finding the primary P^ 



a i-l a i a i+l 

“ ! 

E(iru) - U i 

var(m^) = 

A 1 

111 

1 


A 2 

-111 

1 - { 2/3 ) a 


A 3 

11-1 

1 - (2/3) a 

a = /B (1 - (2/3) a) 

A 4 

-1 1 -1 

1 - (4/3 ) a 

.... 





B = 1/SNR 

A 5 

1-11 

-1 + (4/3) a 


A 6 

-1 -1 1 

-1 + { 2/3 ) a 


A 7 

1 -1 -1 

-1 + (2/3) a 


A 8 

-1 -1 -1 

-1 



When we consider = 1, there are four possible 
sequences, (A^ A 0 , A 3 , A 4 > , involved in finding the term 

P{m. < 0 I a- « 1). Thus, 

iti 
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P ITU < 0 

1 


a. = 1 

i 


d/4) £ 

3=1 i 


(l/Z^TTcr) exp - 


(x - y.r 

a* 


W h ere ^ A E{m^}. Treating the case for - -1 in the 
same manner, we have 


P = (1/2) (1/4) £ 

3=1 i 


(x - M . ) 


(1//2ttc0 exp - ^ dx 


oo . . Z 

S f {x - y.) 

+ (1/4) £ (l//2rra) exp - — ^ dx 

j = 5 0 2 


4 3 

(1/8) £ <M-U-/a) + Z 4>(u-/a). 

j=l - 1 j = 5 J 


(4.11) 


where 4> (a) = j (1//2tt) • exp (-x^/2) dx (4.12) 

— OO 

Substituting mean values, (4.11) can be simplified as follows 


P = (1/4) U (-1/a) + 2 <M-(1 - 2a/3)/a) + 4>(-(l - 3a/4 ) /a) } 

(4.13) 


The probability of the final detection is found as 
follows. Since the final decision su depends on the previous 
final decision a._, and on the primary decision on (i+l)th 
bit, a. + ^, we have 


a . - m . 
i i 


K. 


‘i+1 



(4.14) 


= K, 


a . . + 

i-l 


K 1 a i + K 3 a i+l + 


K 4 n i 




where 
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Hence, the probability of error is described by a recursive 
relation. Let us define 


P. £ {p a. < 0 | P ^ a i^ P ^i+1^ P ^i-1^ 

(4.15) 


Rewriting (4.14) by substituting nr in the equation, we 
have 


a. = K 0 
l 2 


(a i-l " h-l 1 + K 1 a i + K 3 (a i+l 


- S. +1 ) + K 4 n. 


(4.16) 


If the primary decision on the symbol is correct, the 
final output of the detector will be just a constant, K ]_ * 
times a . . It can be seen from the simulated results that 
at high SNR the probability of error for the final detec- 
tion decreases faster than that of the primary detection. 

The probability of error for the final detection, P^, 


P. = P { a . < 0 
i i 

+ P{a , < 0 

r 

+ P { a . < 0 

i 

+ P{a i < 0 


a i =1 ' a i+l =a i+l' a i-l =a i-l 

a i =1 ' h+i =a i+i ' h-i^i-i 
a i =1 ' a i+l 5/a i+l' a i-l =a i-l 
a i =1 ' a i+l^ a i+l ' a i-l =a i-l 


} ( 1 / 2 ) (1 
} ( 1 / 2 ) (1 
} (1/2) P 
} (1/2) P 


- P! (1 - 

- 5) P i-1 


+ four terms for = 


- 1 . 


(4.17) 



Table 4.4 Possible sequences and mean values 
for finding the final 



a i-X =a i-l ' 

1 

a i+l~ a i+l 

a i-l/ a i-l' 

a i+l~ a i+l 

a i-l =a i-l ' 

a i+l^ a i+l 

a i-l^ a i-l ' 

a i+l^ a i+l 

a i-l =a i-l' 

a i+l =a H-l 

a i-l^ a i-l' 

a i+l =a i+l 

a i-l =a i-l ' 

a i+l^ a i*+l 

a i-l^ a i-l' 

a i+l^ a i+l 



EtSil 

A n i 




n l - 

K 1 




^2 = 2 K 2 

a i-l 

+ K x 



n 3 = Ki + 

2 K 3 

a i+l 


n 4 

= 2 K 2 a i-l 

+ K 1 

+ 2 K 3 

a i+l 


n 5 = 

- K 1 




n 6 = 2 K 2 

a i-l 

" K 1 



n 7 = -k x + 

2 K 3 

a i+l 


1 i — -• 

CO 

= 2 K 2 a i-l 

- K 1 

+ 2 K 3 

a i + l 


Setting 1 - - Q, P ± _ 1 - P, 1 - P - Q, we have 


C 0 

P i - (QQ/ 2 ) lUn lf o) dx + (PQ/ 2 ) | N { n 2 / a ) 


0 0 
+ (PQ/ 2 ) f N(n ,,a) dx + (PP/ 2 ) N(n 4 ,cr) dx 


CO w 

+ (QQ/ 2 ) N(n 5 ,a) dx + (PQ/ 2 ) j N(ngra) dx 


+ (QP/ 2 ) \ N (n*7 * cr) dx + (PQ/ 2 ) f N(ru,a) dx 


[•] 




.Fig. 4. 7 (a) Comparison between analytical 
results and simulation results 


ALFA - 0.3 


Probability of Error, Analytical 
Results 

Probability of Error, Simulation 
Results 


Probability of error of the primary detection 


Probability of error of the final detection 



Fig. 4. 7(b) Comparison between analytical 
results and simulation results 


ALFA - 0.4 


Probability of Error, Analytical 

Results 

Probability of Error, Simulation 

Results 


: Probability of error of the primary detection 


p : Probability of error of the final detection 
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Table 4.5 Program for evaluating the primary P^, and the final P^ 


REAL Kl,K2,K3,P(iO),Q(iO) 

99 READ (1 ,100 , END=999) SNR, ALFA 

100 FORMAT(2F5. 2) 

C 

K1 = 1. -2. *ALFA/3. 

K2= ALFA/3. 

K3 = K2 

SIGMA = SQRT((1. - 2. * ALFA/3.) /SNR) 

A - -1. /SIGMA 
B = -Kl/SIGMA 

C = -(l.-4.*ALFA/3.)/SIGMA 
C COMPUTE THE PRIMARY PROBABILITY OR ERROR 
Pi = 0.25* (PHI (A) + 2. *PHI(B) + PHI(C)) 

WRITE(3 ,101) SNR, ALFA, PI 

101 FORMAT (/5X'SNR =, F5. 2 , 5X, 'ALFA='F5. 2 , 5X, ’PRIMAY P(E) IS 1 , 

1 F16.7) 

C - 

Q1 - 1. -PI 
P(l) =0.0 
Q (1) = l.-P(l) 

Cl - PHI(-K1/SIGMA) 

C2 - PHI(-(Kl-2. *k2)/SIGMA) + PHI(-(Kl+2. *K2)/SIGMA) 

C3 = PHI(-(K1-K3) /SIGMA) + PHI(-(K1+K3)/SIGMA) 

C4 = PHI(-(K1-2.*K2-2.*K3)/SIGMA) + PHI(-(Kl+2 . *K2+2 . *K3) 

2 /SIGMA) + PHI(-(Kl-2. *K2+2. *K3) /SIGMA) + PHI (-(Kl+2. *K2 

3 -2 . *K3)/SIGMA) 

C COMPUTE THE FINAL PROBABILITY OF ERROR 
DO 2 1=2,10 

P(I) = Q1*Q(I-1)*C1 + Q1*P(I-1)*0.5*C2 + P1*Q(I-1)*0.5*C3 + 

4 Ql*P(I-i)*0. 25*C4 
Q (I) = l.-P(I) 

WRITE(3 ,102) I , P (I) 

10 2 FO RMAT (/l 5X , ' P (' , 1 2 , ') =* , F16 . 7) 

2 CONTINUE 
GO TO 99 
999 STOP 
END 


(continue on the next page) 



(Table 4.5 continued) 


FUNCTION PHI(X) 

AX = ABS(X) 

T = 1. 0/(1. 0+0. 2316419*AX) 

D = 0.3989423*EXP(-X*X/2.0) 

P - 1.0-D*T*((((l. 330274*T-1.821256)*T+1. 781478)*T- 
1 0.3565638)*T+0. 3193815) 

PHI = P 
IF (X) 1,2/2 

1 PGI = 1. 0-P 

2 RETURN 
END 

/DATA 

/END 



a* 

where the notation N(n^,u) indicates the density function 
of a Gaussian distribution having a mean value and a 

vsrisncs cr^» Now we can substitute the values for 
i = l, 2, . .., 8 ? and write P^^ as the function of the 
^-function defined by (4.12). Note that <M~x) * 1 - <t> (x) . 

(4.18) can be further simplified by using this identity. 

Therefore , 

p. = [QQ] <j>(-K ./a) + (PQ/2 ) [cj> (-(K -2K 2 )/c) + <f> (- (K ± +2K 2 ) /a) ] 

+ (QP/2) [<*> (- (K x - K 3 )/a) + (j>(-(K x + K 3 )/a)] 

+ (PP/2) [4>(-(K 1 - 2 K 2 - 2K 3 )/a) + <P (- (K 1 + 2 K' 2 + 2 K 3 )/t) 

+ 4>(-{K 1 - 2 K 2 + 2K 3 )/o) + <j)(-(K 1 + 2 K 2 - 2 K 3 )/a)] 

(4.19) 

The analytical results of the primary and the final 

P can be evaluated by a computer program shown in Table 4.5. 

£ 

The results are plotted with the simulation data found in 
the last section to see how closely they are related. It is 
seen from Figure 4.7 that when a = 0.3 and 0.4, the analyt- 
ical results and the simulation results are in good agree- 
ment . 


III. BIT SYNCHRONIZATION 
A. Synchronizers for Non-Overlapping Symbols 

Wintz and Luecke [8] derived the optimum synchronizer, 
in the maximum likelihood sense, for binary non-overlapping 
symbols in Gaussian noise. The starting point is the 
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derivation of the relationship for p(Y|0) , where Y is the 
observation y (t) for te(o,nT). The maximum likelihood 
synchronizer is a device for computing this probability, 
as a function of 0 and then choosing the value of 0 which 
maximizes the expression. The probability p(Y|8) is com- 
puted by first finding p(Y|G,a) where a is the bit 
sequence a Q , a^ a 2 . . . a^. Then p (Y | © , a) is given by 

p (Y | 9 ) = Ep (Y | 0 , a) p (a) 

All a 


The p (a) used is the A priori probability of any given bit 
sequence, assuming all 2^ are equally likely. This gives 
rise to the expression 


p (Y 8) 


N-l 

" n 

0 


COSH 


N 


T 

■ 

0 


y (t + jT + 0) s (t) 


dt 


or In p {Y | 0 ) 


C + 


N-l 

2 

j = 0 


T 


log COSH 



y (t + jT -f 


6 ) s (t) dt 


The synchronizer then maximizes this likelihood function. 

The function log cosh(x) is an interesting one: for small 

2 

| x j it is approximately while for large |xj it is 

approximately |x| - ln2. The expression 

T 

I log COSH ^ y (t + jT + 0)s(t) dt = <|/. 

0 0 

u T-8 

= f y (t + jT) s (t - S) dt 


-6 



may be obtained from a correlator with an integrate-and 
dump . 



The maximum likelihood synchronizer is mechanized by a 
bank of these units followed by a unit which selects the 
0^ which produces the maximum output. 



For continuous signals this synchronizer can be 
greatly simplified. I-f we write 


T-0 


L (0) = Y log COSH_-^ y (t + jT)s(t - 9) dt 

'■ 0 -0 


At this point it is convenient to introduce an inner 
product notation 
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T 

y(t + jT)s(t) dt & <Yj/ s > 

0 

then s (t - 0) = s (t) - 0 s’ (t) 

and L(8) = ) log COSH jji [<y.,$> - 0<y.,s> ] 

the optimum estimate 0 is found by 

N o It = 0 = < y j'^ tanh[ ir ,( <yj' s > - e <Yj - s ’> >i • 


2 

Expanding tanh (X + 0e) — tanh X + 0 e sech X, 



which yields 


0 



The denominator converges to a constant times the number 
of bits, and the resulting configuration is 








This configuration has some interesting properties* For 

high SNR, tanh (-^-) is a hard limiter, and the combination 

o 

of the matched filter and nonlinearity is a bit detector. 

At low SNR, the detector is more like a difference of 

squares configuration. It should be noted that this 

linearized synchronizer does not work for square signals, 

because s (t) is not di*'f f erentiable . The bank-of-f ilters 

synchronizer works but is impractical. The option usually 

chosen is the early - late gate synchronizer described, in 

various forms by Simon* [9] , Stiffler [10] , and others. A 

discrepancy also exists here between the well-known Wintz 

Sl Luecke results and the usual practical situation where 

the transmitted signal is a square signal passed through 

a of i Iter . The result is an overlapping signal, not the 

non-overlapping version. A second difficulty stems from 

using the a priori probability for P (a) . Another approach 

is to use P(aJ where a-, is the detected bit sequence, 
a a 

This gives rise to a hard limiter rather than a hyperbolic 
tangent, or an absolute value rather than a log cosh. It 
has been shown by Simon [9] , that the absolute value 
early-late gate is better than the squared loop. This 
approach can also be used with the overlapping signal 
case, and the resulting configuration is much simpler. 

B. ML Synchronizer for Binary Overlapping Symbols 


Wang [11] has developed the maximum likelihood 
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synchronizer for generalized binary overlapping symbols. 

The synchronizer structure consists of matched filters, 
a transition detector and an accumulator. The form of 
the synchronizer does not lend itself to simple imple- 
mentation. The results, however, are new, and provide 
some insight into the solution of problems with more 
practical waveforms than have been treated in the 
literature . 

For the purpose of computer simulation the idealized 

overlapping NRZ waveform shown in Figure 5.1 was used. 

The analytical expression for the overlapping signal, 

S (t) , is also a function of a, where a is defined as the 
P 

overlapping parameter and is in the range from -0.5 to 
+0.5. The received signal waveforms are indicated by 
Figure 5.2(a) for the noiseless case, and by Figure 5.2(b) 
for the noisy case. The dotted line in the figure shows 
the individual overlapping symbol and the solid line is 

the actual received waveform. 

The received signal is perturbed by an additive 
noise, n{t), which is assumed to be a sample function from 
a Gaussian random process with zero mean and known vari- 
ance. The input to the synchronizer is of the following 
form, 

y (t) = S (t; 0 ,A) + n (t) , 0 <_ t < m (5.2) 
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where A = (a^, a 7 t • ••/ ' 

a. = +1 or -1 with ectual probability, and 
3 * ' 

8 = epoch to be estimated which is assumed 

uniformly distributed between -1/2 and 

+ 1 / 2 . 

1. Derivation of Optimum Synchronizer 

In order to find the maximum likelihood (ML) solution, 
the conditional probability function P (Y | 0 ) is required. 
Owing to the presence of the random variable A, the follow-, 
ing expression is considered. 


P(Y|0) 


r 

P(Y|e,A)P(A) dA 
A 


(5.3) 


We now find the conditional probability density 
function by using sampling approach, first taking II samples 
in each interval, and then letting the samples become dense, 
thus obtaining an integral form for P(y| 6,A). For each 
sample i, Y(i) = S(i;0,A) + n(i), i=l , 2 , . . . ,mN, where n(i) 
is Gaussian distributed with zero mean and variance B^N. 

The conditional joint pdf, P(y| 0,A) for mN samples is writ- 
ten as: o 

mN 2 

P (Y | 6 , A) = n (1/2 BN) exp{-(l/2B 0 N) [Y(i) - S(i;9,A)] } 

i=0 

(5.4) 

When N becomes very large, (5.4) can be written as an 
integral as follows. 
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m 


P (Y | 0 , A) = K 1 exp 


-(1/2B ) [y (t ) - S (t ; Q , A) ] 2 dt 


0 (5.5) 

where K 1 is a constant. Because of the overlapping situation, 
the set of random variables {a^}, j=l , 2 , . . . ,m, are correlated 
with each other. Thus P(Y|0,A) cannot be expressed as the 


product of the conditional pdf of individual symbols, name- 
ly, P (Y | 0 , a j ) , j -1 , 2 , . . . ,m. In order to proceed, we group 
the signal sequences as follows. 


m-1 

S { t ; 0 , A) = E [a^S (t-j?6) + a j+i S p (t ~ 9 > ] 
3 — 1 


(5.6) 


and integrate each interval from ( j — 1/2.) to (j + 1/2) , so 
that (5.5) can be further simplified as follows: 


m-1 

P (Y | 0 , A) = K, n exp 

j=l 


-(l/2B o ) 


j+1/2 

j -i/2 


[y (t) - a j S p (t~ j ; e ) 


- a j +1 s p <t-j-i?e>] dt 


(5.7) 


There are six terms to be considered if we expand out 
the above expression. However, three of them, involving 
the integration of squared terms, are actually constants. 
Hence their product can be combined with to form 
another constant K^. Since is not a function of 0, 
it. will not enter into the maximizing process. We simply 
ignore this quantity for awhile. Note that if 9 is also 
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assumed to be stationary, we can write S(t;0) = S(t-0), 
for -1/2 <_ 8 <_ 1/2. Therefore, (5.7) is reduced to 

m-1 

P(Y|0,A) = H exp{ajBj{0) + (0) " a j a j+l D ^ (5.8) 

j +1/2 

where B_. ( 0 ) = (1/B 0 ) y (t) S p (t-0- j ) dt (5.9) 

j “1/2 

j+1/2 

C . ( 0 ) - (1/B ) I y(t)S (t-0 - j -1 ) dt (5.10) 
j o p 

j ”1/2 

j+1/2 

D = (1/B ) S. (t-e-j)S (t-e-j-1) dt (5.11) 

' o p J p J 

j-1/2 

D can be calculated immediately to be a/3 and is not a 
function of 6. The calculation of Bj(8) and 0^(9} proceeds 
as follows. When there is no transition in the interval 
(j-1/2, j+1/2), 

B.(0) « ((a. + a j+1 )/2B 0 ) (1/2) (5.12) 

C , (0) = Bj (0) . (5.13) 

When there is a transition in the interval (j-1/2, j+1/2), 

the situation is described by Figure 3.3 for the case 

a. = 1, and a. n = -1. After integration, the values for 
3 3+1 

B.(6) and C.(0) can be found as follows. 

3 3 
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1/2 

B. te) = ((a. - a.. 1 )/2B n ) y (t) S (t-8) dt 

3 3 3 +1 0 J 

- 1/2 

= t . • (1/2 - (2a/3) - (8 2 /2a) + (8 3 /12a 2 ))., for 0 > 0 

(5.14) 

C. (0) = t j • (-1/2 - (2a/3) + (0 2 /2a) - (0 3 /12a 2 )), for 0^0 

(5.15) 

where t. = (a.. - aj +1 )/2B Q . For the case 0< 0, it can be 

found that the values for B^(0) and (0) are the same as 

those. indicated by (5.14) and (5.15) but with a different 

sign. Figure 5.4 shows the case for finding B^(0) and 

C . (6 ) when 6<0. In summary, B. (0) and C. (0) can be 
D j j 

tabulated in Table 5.1: 
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The next problem is to maximize j P(y|G,A)P(A) dA 
t6 obtain the optimum estimate. Owing to the overlapping 
situation, the exponential term in (5.0) consists of both 
the symbol and the following symbol a^ +1 . The averag- 
ing process is therefore of a recursive nature. Further, 
the random variable is equally likely to be +1 or -1 
so that four different cases should included. For con- 
venience, let 

Q (8 / a j ,a j + 1 ) = exp(ajB_.(0) + a j +1 C j( 0 ) - a j a j + 1 D) , (5.16) 

and let 

Q (0 , a ^ = 1 , a j + ^=l) be represented by simply 0(1,1). If 
we use the subscripts 0 and 1 to represent the symbol -1 
and +1, respectively, the probability of (j+l)th stage can 
be written as a function of the j th stage as follows: 

P (j + l) = P (y| 0 , j+l , 1) = P (y| 6, j,-l)Q(-l,l) + P(Y|e, j,l)Q(l,l) 

(5.17a) 

p (j+i) = p ( y| e, j+i ( -i) = p(y| 6, j,-i)Q(-i,-i) 

+ P(Y|e,j, 1)0(1, -1) (5.17b) 




The next step is to compute the average of PqO + D 
and P^j+1) using the following equation: 

/ P 2 (j+1)\ A A / P n<3 + 1 A 


= ( 1 / 2 ) 


^3(3+1)/ 

L A 


V -7 


= ( 1 / 2 ) 


/ Q (-1 < -1) Q(l,-1)\ 


ll lj\Q(-l,l) Q(l,l) / \l/2 I / 3 / \ P 3 ( j )/ 


\Pj_< 3+1)/ 

1/2 1/2 


/ 1/2 1/2 \ /p, ( j )\ 


(5.19) 


To write (5.19) in a matrix form, we have 


P(j+1) = H j ( 6 ) P ( j ) 


(5.20) 


where (6) is a two by two matrix having the following 


elements , 


h n ) 

= 


-C . 

h 12 (9) 

= -e ^ 
C . 

- e ^ 

h 21 (0) 


C . 

h 22 ( 0 ) 

= -e 9 


C . 

i 9 , 

C . 

> 0 

-c . 

J 9 
+C . 


(5.21) 


The associated synchronizer structure is shown in the next 
section . 

2. The Synchronizer Structure 

The ML synchronizer structure consists of matched 
filter, a transistion detector, a weighting function and 
a feedback circuit. To obtain the maximum value of the 













density function for a given received y(t), y (t) is first 
correlated with the overlapping symbol S (t) and S p (t-1) 
separately in the time interval (1/2, 3/2). The transi- 
tion detector is a device which examines a^ and a^ +i an 
the presence of noise, and records an output t ^ according 
to the following rules: 

If 3j = a j+1 , t. = (a. + a j+1 >/2. 

If + a j+1 , = ( 3j - a j+1 )/2. 

The output of the matched filters and the transition 
detector are then passed to a weighting function which 
computes the four Q— functions. Then the conditional 
probability density function for each stage is calculated 
and stored. The feedback circuitry is used here to 
generate the conditional probability density function 
recursively. At the end of the mth symbol, the output 
statistics in each stage are compared, and the largest 
statistic is announced as the estimate of the correct 
synchronization position. The maximum likelihood syn- 
chronizer consists of a bank of devices followed by a 
maximum value selector. In a manner similar to that 
employed without overlapping symbols, a single line syn- 
chronizer can be developed for continuous S(e). The 
correlator output can be recognized as a transition 
detector. The exponential form of the' nonlinearities can 



again be recognized as a result of using the a priori 
probability P (a) in the derivation. If P (a^) , the prob- 
ability after detection, is used, the result is a 
detector used to control a matched derivative filter. 

This results in a much simpler structure and is in fairly 
close correspondence with many existing units. 

3. Monte Carlo Simulation Program and Results 

In order to find the exact value of the conditional 
probability density function P(y| 6), we again examine (5.7) 


i+1/2 


m-1 p r 

P(Y|e,A) = n K x exp|-(l/2B 0 ) j [y(t) - a i S p (t-i-6) 
i=l ■: t 


i-1/2 

- a . , , S (t-i-1-0) 2 dtl 
1 + 1 P J 


m-1 


n K 1 exp{K 5 + a i B i (6) + a. +1 C.(0) 
i = l 


where 


= 1//2itB o . 


a . a . , -j D} . 
i l + l 


(5.23) 

(5.24) 


K r can be written as the sum of there terms 
5 


K 


5 = K 2 + K 3 (0) + K 4 (6) 


(5.25) 


i+1 


where 


K 2 * 


(l/2B o ) 


/2 


y (t) dt 


i-l/2 


- (3 - 4a) /6B , if there is a transition 


- (1/2B ) , if there is no transition 


(5.26) 
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i+1/2 

K 3 (0) = -(1/2B 0 ) | S p 2 (t-0-i) dt 

i-1/2 

1/2 

= -(1/2B 0 ) j S 2 (t-e) dt 
1/2 

= - (1/2B ) [- a/3 + 1/2 + 0] (5.27) 

1/2 

K 4 (0) = -(l/2B o ) | S 2 (t-e-1) dt 

1/2 

a - (1/2B ') [- a/3 +■ 1/2 - 6] (5.28) 

At first glance, K 3 (0) and K 4 (0) are functions of 8 so 
that they ought to be included in Section 3.B. However, 
their sum indicates that is not a function of 0. That is 


k 5 = K 2 + k 3 ( q ) + k 4 ( 0 ) 

- ( (1 - 2a)/B ), if there is a transition 

= (5.29) 

- ( (3 - a)/ 3 B o ), if there is no transition 

The input bit stream for the simulation program is generated 
by a uniform random number generator. The description of 
this subroutine is given in Appendix A. The signal-to-noise 
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ratio (SNR) in the program is the power ratio indicated by 
numbers. 0 in the simulation program is the true value. 

For 40 bits as the input data to the ML synchronizer, the 
probability density function versus different 0 are plotted 
in Figure 5.7, using SNR as a parameter. The graphs appear 
to be nearly Gaussianly distributed with' center around 
0=0. At high SNR, the curve tends to peak up at the 
origin and to flatten out rapidly as the SNR decreases. 

C. Analysis for Bandlimited Overlapping Signals 

The received signal in satellite telemetry has some 
overlap between bits that may be caused by the transmitter 
filter, the channel or by the receiver filter. In most 
cases the most severe bandlimiting is due to the receiver 
IF section, but even here the symbols are usually contained 
within two bit periods. 

Suppose we receive the signal 

CO 

y(t) = y\ a s(t-0-nT) + n(t) , 

4 — n 

— oo 

pass it through an ideal low-pass filter of bandwidth B, 
and let the output be given by v* (t) , where 

CO 

y* (t) = £ b n (t) + n L (t) . 
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The conditional pdf of y* (t) , given sync error 0 and 
signal sequence A, is given as 

P(y*(Y)|0,A) 

N N 2 

« K, exp{-(l/2B ) Y lY* W “ Y a,S (n-k-B)] } 

1 0 n=l k=l X P 

(6.4) 

We now use the fact that the overlapping signals with 
synchronization error 8, can be approximated by the follow- 
ing linear relationship: 

S (t - 0) = S (t) - 6 S' (t) (6.5) 

The associated waveforms are shown in Figure 6.1. For 
small 0, 'the difference between the two curves is small 
enough to be neglected. Using this approximation in the 
conditional probability density function, 

P (y* (t) | 6 , A) 

N N 

= K exp{- (1/2B ) Y, Ky*<n) - £ a k S p (n ~ k ) > 

1 n=l k=l p 

N ? 

H [ a. S' (n-k) ] z } (6.6) 

k=l K p 

To find the optimum estimate of 6, we set 
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Fig. 6.1 Linear approximation of the overlapping signal 
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Sin P (y* (t) 8 , A) 


= 0 


6 = 8 


ML 


Thus , 


N 


N 


N 


£ [y* (n) - £ a k S p (n-k) + 8 £ a k S p (n_k)1 


n=l 


k=l 


k=l 


P 


N 

£ 

k=l 


a, S ' (n-k) 
k p 


= 0 


(6.7) 


9 = 6 


ML 


Solving for 8, we find the following result 


N 


N ( nJ " £ k S p ( k) 3 *• J--, a k S p n 

a = _ V k = 1 k = 1 

ML 

n=i 


N N 

y y a, a. S' (n-k)S' (n-j) 
k 3 P P 


(6.3) 


N 


N 


N 


= K £ [y* (n) - £ a, S (n-k) ] [ £ aS'(n-k)] (6.9) 

n=l k=l K p k=l K p 


The above ' derivation leads to a synchronizer which is 
roughly sketched in Figure 6.2. 

The received signal is first passed through a detector 
to form the original overlapping signal and then the 
derivative of the signal. Meanwhile, it is bandlimited by 
passing through a low-pass filter with bandwidth 2B. After 
forming the signal, we subtract the two waveforms, and the 
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difference is further multiplied by the derivative of the 
original signal, d(t). The final block is an accumulator. 
The operation of the synchronizer is shown in Figure 6.3(a) 
and 6.3(b). With the input signal having different delays, 
the estimated values of 0's are shown as functions of 8 ? s. 



Fig. 6.2. Block diagram of the 

suboptimum synchronizer 

Furthermore, the detector portion is replaced by the 
DD detector investigated in Chapter VI. The overall block 
diagram is given in Figure 6.4. In order to simulate this 
system, we need to have the theoretical expression of the 
bandlimited signal by ‘Fourier analysis and the bandlimited 

i 

noise by autocorrelation analysis. This will be considered 
in the next section. 

1. Bandlimiting and Sampling of the Overlapping Signals 

To find the output of the filter, we shall first find 
the Fourier transform of the overlapping symbol. It is 
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X 


z (t , e) 



Fig. 6. 3(b) Output v 
6<Q 
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that if. the symbol is differentiated with respect to time 
twice, a sequence of impulses can be obtained. The trans- 
form of the impulses is readily found. Let the symbol be 
centered at origin and be called f (t) . It is evident 
from Figure 6.5(c) that 

2 

£-§■ « (l/2a) [<$ (t+l/2+a) - 6<t+l/2-a) - 6 (t-l/2+a) 
dt 

+ 6 (t-l/2-a) ] (6.10) 

Using the Fourier time shift theorem, we have 

(jw) 2 F(w) = (l/2a) j~exp [jw (1/2+a) ] - exp [ jw (1/2-a) ] 

- exp [-jw (1/2-a) ] + exp [ jw (1/2+a) 

Thus , 

F (w) = (1/aw 2 ) [cos (1/2-a) w - cos(l/2+a)w] (6.11) 

The time shift theorem is used again to obtain S (w) , the 
Fourier transform of the overlapping symbol, S (t) . 

S (w) = (1/aw 2 ) [cos (1/2-a) w - cos (1/2+a) w] exp (- jw ( 1/2 ) ) 

P 

9 

S (w) = (l/aw~) 2 sin(w/2) sin (aw) • exp(-jw/2) 

P 

= Sa(w/2) Sa (aw) • exp(-jw/2), (6.12) 

Sa (x) - sin x/x . 

Let the output of the filter be 

N 

y* (t) = £ b n (t) + n x (t) . 

n=l 


where 
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Then the Fourier transform of the nth bit is 


B (f) - 
n 


a Sa(TTf) Sa(2Traf) • exp (- jirf (l + 2n) ) 
n 


0 , 


-B <_ f <_ B 

elsewhere 

(6.13) 


The time response b n (t) is 


B 


b ( t) = 
n 


B (f) • exp(j27ift) df 


(6.14) 


-B 


B 

f 


-B 


a Sa(iTf) Sa{2naf) * exp (-jirf (l+2n-2t) ) df 
n 


Substituting uf » x, we have 


ttB 


b n (t) - ( 2 /tt ) | Sa(x) Sa (27tc*x) cos (l + 2n-2t) x dx (6.15) 

0 

The response of the sample due to an infinite bit train can 
be expressed as 


y* (t) = E b n (t) + n i ^ 


n-- 00 


= a Q (2 /tt) 


71 B 


Sa (x) Sa(2ax) cos(l-2t)x dx 


ttB 


+ £ a n < 2 A) 


n=-°° 


Sa (x) Sa (2ctx) cos (l+2n-25) x dx 


+ n^(t) 


(6.16) 
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The first term is the desired signal and is peaked at t - 1/2, 
for B < 1. The second term is the inter symbol interference 
due to bandlimiting the signals* Thus, sampled at t = 1/2, 
the response can be simplified to give 

y* (t-1/2 ) = a S(B,0) + V a S(B,n) + n 1 (t) (6.17) 

n =-GO 

ttB 

where S(B,0) = (2/tt) j Sa(x) Sa(2ax) dx 

0 

ttB 

S (B,n) = (2/tt) [ Sa (x) Sa(2ax) cos(2nx) dx 

0 


The filter noise has the variance 


2 

o 


N 


-B 


H(t) 


df = N Q B 


2. Simulation Results 

A program was written to evaluate the performance of 
the synchronizer developed above. One sample run of the 
program is presented here, using 10 random bits as the 
input data stream, with SNR of 5 and an overlap a = .25. 

D. Synchronizer for Overlapping Split-Phase Signals 

1. Bandlimiting and Sampling 

Using the same technique as in Section B, the Fourier 
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transform of the overlapping split phase (S$) symbol g (t) 
as shown in Figure 6.9 is written as 

= (l/2a) [6 (t+l/2+a) - 6 (t+l/2-a) + 6 (t-l/2+a) 

dt 2 

- 6 (t-l/2-a) ] + (1/a) [- 6 <t+a) + 6 (t-a) ] (6.2C 

Thus, using the transform pairs, we have 

(jw) 2 G{w) = (l/2a) [exp ( jw (1/2+a) ) - exp (+ jw (1/2-a) ) 

+ exp (-jw (1/2-a) ) - exp {-jw (1/2+a) ) 3 
+ (1/a) [- exp(jwa) + exp(-jwa)] 

— (j/&) C sin (1/2+a ) w - sin(l/2-a)w] - (2j/a) . 

sin (aw) . 

as (2 j/a) [cos (w/2) sin(aw) - sin (aw) ] . 

2 

Thus, G (w) = 2 j [sin (aw) /aw ] [1 - cos (w/2)] 

Then the Fourier transform of the overlapping S<J> symbol, 

V t)# is 

S, (w) = G (w) exp(-jw/2) (6.23) 


( 6 . 21 ) 

( 6 . 22 ) 


Let w - 2iTf 4 2x , 

S (f) = (j/x) (sin (2ax)/2ax) (1 - cos x) exp(-jx) 

T 

= j Sa(2ax)[(l - cos x)/x] exp(-jx) (6.24) 

If the output of the LPF is 

OO 

yj (t) = z b n (t> + n i (t) ' 

v n~- w 







The Fourier transform of b (t) can be written as 

n 


B (f) = j Sa(2ax)[(l - cos x)/x] exp (- jx ( l+2n) ) . (6.25) 


Thus , 


b n (t> 


B 

B (f) exp ( j 27rft) df 
-B 


a 


n 


ttB 

. r 

1 
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Sa ( 2ax) [ (1 


cos x)/x] exp (- j x (l+2n-2t) dx 


ttB 


= a n ( 2 /tt) 


Sa ( 2ctx) [ (1 


cos x) /x] s i n ( 1 4- 2 n - 2 1 )~x dx 


The signal portion is found as follows, 


ttB 


y*(t) = (2/tt) 


Sa (2ax) [ (1 - cos x)/x] sin (1-2 1) x dx 


(6.27) 


IV. TRACKING LOOP ANALYSIS 
A. Optimal Linear Estimation 

In work previously reported [2] , the form of an optimum 
synchronizer employing a Kalman tracking filter was present- 
ed. In this model the, bit detector forms an estimate of the 
timing error based on a comparison operation involving one 
split-phase data bit. ‘This output, derived from the bit 
detector threshold logic, is used as in input to the track- 
ing rate portion of the conditioner. The timing estimator 
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is relatively slow, and works on an average of the 
threshold logic outputs over a period which is long with 
respect to the bit rate, but short with respect to 
tracking rate phenomena. When the central limit theorem 
is invoked, these averages can be considered as continuous 
signals with a Gaussian amplitude distribution. 


1 

BIT DETECTOR 

AND 1 

TRACKING ' 

THRESHOLD j- 

' FILTER 

LOGIC } 

i 
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OPTIMAL ESTIMATE OF 0 


The observed s.ianal-plus-noise vector is thus trans- 
formed,, through the MAP estimator output, into a new domain 
such that a state vector X is linearly related to the out- 
put. That is, the MAP estimator output can be expressed 
in the form 

Z (t) « H (t)X (t) + v (t) , 

where V(t) is zero mean, white, and Gaussian "measurement 
noise". With this interpretation of the threshold logic 
outputs a minimum variance estimate of the true bit transi- 
tion may be obtained using the powerful Kalman filtering 
algorithm and making full use of known process dynamics. 




1. Time Base Error 

One of the more important factors which is required 

i " 

for this analysis is an analysis of the time-base error- 
in the incoming recorded signal. The primary causes of 
this error seem to be satellite tape recorder flutter, 
the doppler effect, and propagation delays in the 
atmosphere. The most difficult cause to cope with is 
probably on-board tape recorder flutter, and it is neces- 
sary to model this flutter in order to optimize the 
tracking rate portion of the synchronizer. 

Chao [12] and Moore [13] discussed measurement and 
causes of time-base error. Both authors give power 
spectra for typical instrumentation recorders. Time-base 
error seems to appear in two forms: a random variety, 

due primarily to tape disturbances, and a . periodic 
variety, due to worn or imperfectly manufactured parts. 

In addition, the speed control servo, and in particular, 
some of its specific measurement methods, enters into the 
design of the tracking loop. 

Worn part periodic TBE poses a difficult problem in 
loop optimization. Adaptive loops are generally distinct 
ly better than fixed-parameter loops in compensating for 
periodic time-base error. High signal-to-noise ratio 
data is of particular benefit in measuring actual record- 
er performance, and the most effective technique is 
probably to use a wideband tracking loop and record the 



loop output. Periodic components can then be detected by 
frequency analysis of this output. The Kalman filter for 
the tracking loop can be obtained once the power spectral 
density of the time-base error is known. This filter is 
valid for any situation where a state variable model is 
available and where the bit synch detector is known to be 
linear. This includes some, but not all acquisition 
problems . 

As an example, a state variable model- will be con- 
structed for the flutter spectrum in Figure 9 of Chao 
[12] . The method of modeling a worn part will be illustrat 
ed by modeling the peak at 4 hz (which is the worst of the 
TBE components shown if left uncompensated) as a pair of 
damped sinusoidal states. The TBE will be modeled as two 
separate components, one resulting from the 4 hz lobe, 
the other from the remainder of the spectrum. The lobe 
(worn part) has the spectral density 

- ( . 0 004 % ) s 2 

2 .2 ' 

+ s + 100) (-— - s + 100) 

and the rest of the spectrum has the psd 

? 4 

-1 (.01%) s 

s 2 (s 2 + 120s + 3600) (s 2 - 120s + 3600) 

Each function can be modeled by a white noise driving a 
filter with a transfer function which is the spectral 
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factorization of the psd, A Kalman filter is then con- 



structed for this TBE model. If the worn part does or 
does not exist with probability 0.5, a measure of the 
effectiveness of an adaptive scheme would be obtained by 
comparing the RMS TBE with no worn part for filters 
designed with and without the worn part. More refined 
loops must be defined with more complete data than that 
shown . 

2. Acquisition 

Acquisition presents several distinct problems in 
the tracking loop. Stiffler (1, pl38ff) develops an 
approximation for acquisition time for a loop with a 
sinusoidal nonlinearity and an initial frequency offset. 

The derivation is very useful in characterizing acquisition 
behavior of bit synchronizers. The relationship states 
that for a second-order loop, the acquisition time is 
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proportional to the square of the frequency offset and the 
mean square of the nonlinearity. For sinusoidal non- 
linearities the mean square is one half, while for typical 
early-late gates it is one forty-eighth. This indicates 
that the bit detector, as well as the loop bandwidth may 
need to be changed during the acquisition phase. 

It may be. seen from the above discussion that the 
initial frequency offset is critical to the acquisition 
time. This offset is 'almost entirely a function of the 
speed control method used in the recorder. Specifically, 
if this initial frequency is accurately known, acquisition 
is very much simplified. Peavey [14] quotes acquisition 
times of one to three thousand bits for • low signal-to-noise 
ratios.. For these acquisition times, the initial frequen- 
cy 'offset also can be contributed by the low-frequency 
(less than ten hertz) TBE. 

Acquisition of a signal of unknown frequency and 
phase can be viewed as a two-dimensional search process. 

The synchronizer effectively looks for the element in the 
search area which appears to contain the signal. Acqui- 
sition can be said to occur when the probability that the 
signal is in a certain element of search area and no other 
approaches one. There is a tradeoff between equipment 
multiplicity, search area, and signal-to-noise ratio. 

It appears possible to hypothesize a situation where 
acquisition might not be possible with any synchronizer, 
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even though tracking might be possible' after acquisition 
has occurred. The fundamental quantity for acquisition 
is 


P (y I x) , 

where x is the tracking state vector. If x = (0,f) where 
0 and f are the phase and bit rate,, respectively we have 
the common situation in acquisition. For acquisition 
to be possible p(y|x) has to approach one for the correct 
element of volume in the search space. 

Under conditions where the bit rate is well known, it 
is possible to perform bit synchronization at signal-to- 
noise ratios well below threshold by using a correlation 
with the frame sync pattern. For the commonly used 27 bit 
pattern, a useful phase data point can be obtained at noise 
levels twenty-seven times the usual clean sync level. The 
tracking loop is optimized as a sampled-data filter. The 
method is not likely to be successful if major TBE components 
exist at frequencies higher than the frame rate, and it is 
relatively useless for data extraction unless the noise 
levels fluctuate greatly. 

B. Non-linear Estimation Methods 

The general nonlinear filtering problem formulated for 
the time continuous case by Kushner and formulated for 
the time, discrete case by Stratonovich applies to various 
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types of communication problems. In this chapter, the 
nonlinear filtering technique is used to solve the bit 
synchronization and detection problems when dealing 
with overlapping signals. The message and observation 
models in this study are described by the following pair 
of stochastic differential equations. 

dx = f_(x) dt 4 - dw (7.1) 

dy - h(x) dt + dv (7.2) 

where x represents the state and dy is the observation, 
w and v are independent Wiener processes. 

The general nonlinear filtering problem is the 
determination of P{x (t) | dy (t) , 0 < t <_ T) , which is the 
probability density function of x(t) conditioned upon the 
observations dy on the interval (0,T). 

Similar results are available for the case where the 
observation is called y and the model is 

y = h ( x ) + n ( t ) (7.3) 

where n(t) represents the white noise. Thus the equivalent 
problem for the observation equation (7.3) is the deter- 
mination of P(x (t) | y (t) , 0 a < T). This approach is used 
by Stratonovich. 

The time continuous case is analyzed by solving the 
following filtering equation for the conditional probability 
density function P: 



where 


P = P{x(t) |dy(t) , 0 £ t < T}, 


f°°f 

E h (x) = h(x) P(x(t)[d^, 0 < t < T) dx(t) (7.5) 

J «,00 


and L , Kolmogorov’s diffusion operator, is defined as 


m 


L+{ * } = - X sir f i {-} + (V 2 ) f t - 1 ^i L (7.6) 

i~l l 1=1 3=1 l 3 


The filter equation for the discrete case is similar 
and can be found from the results of Stratonovich , 


m 


dP. = T a. .P . 
1 i = l ^ 3 


dt + P.Cdy - E h(x) dt}V -1 {h (s . ) - E h (x) } 


V 


where 


P i = P { x ( t ) = s i (t) |dy(t) , 0 < t < T}, 


(7.7) 

(7.8) 


m 


E h(x) = T h(s. (t) ) * P. 

i-1 1 1 


(7.9) 


and the corresponding L can be described by a matrix whose 
elements are the transition probabilities? 


a.. = lim Pr{x (t+At) =s . (t+At) | x (t) =s. (t) )/At (7.10) 

J At + 0 : 1 


a . . = - lim 1 - Pr{x (t+At) -s . (t+At) x(t)=s. (t) }/At 
At - 0 1 1 
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1. An Example 

Suppose we have received a sequence of binary NRZ 
signals with synchronization error 0 and noisy observa- 
tions. Find the filtering equation for the probability 
density function and the nonlinear bit synchronizer 
structure . 

For the noiseless case, the observed symbol in the 
interval 


[(n-1) + 9, n+0], n-l,2,...,N 


is 


s n (t) 



(7.11) 


A typical received signal waveform is indicated in 
Figure 7.1(a). To formulate the filtering equation, let 
us first define the following, 



for n < t <_ n + 6 

i , j = -1,1. (7.12) 

for n+9<t<n + l 


and the probabilities, 

p'T (t,6) 

= Pr{s n (t)=i, for (n-1) <_ t <_ (n-1+0) ? 

s n (t)=j, for (n-1+8) <_ t <_ n} . (7.13) 


N. 


where 


i,j = -1,1 


in ♦ jf 
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b Overlapping Signal 
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Let 


y = s n (t) + dv/dt 


(7.14) 


be the observation on the interval (n-l,n) and E (dv ) - 

B dt where B is the equivalent spectral density of a 

0 o 

white noise. 

Using the result of Kushner [15] , the probability 

P n . (t,6) must satisfy the following filtering equation: 

1 j 

(t,8) = L + {P"j (t,9) } + (t,0) (y - m 6 (t) ) (s?. - m e (t) )/B q 

(7.15) 

where 


L + P?. (t, 0) = 

J 


n 

- X 


,n 


r=l i 


S5E7 f i (x) p ij (t ' e) 


+ 


(1/2) x x 


n n S 2 _n 


£=1 j=l 5x i Sx j 13 


P“, (t,9) 


(7.16) 


and m Q (t) 

o 


1 1 

X X 

i=-l j=-l i 


s" (t,0) dt 


(7.17) 


If 6 is assumed to be constant at least for several bit 
periods , the term L + P^?j (t,0) is zero and the equation 
reduces to 

p".(t,9) = (t/6) ( Y - m 0 (t))(sj j - m 0 (t))/B o (7.18) 

If the symbols are independent and equally probable, 
the following relations can be found. 


7 S 


P? . (n, 6 ) = P? ,(n,0) = (1/2) P^: 1 (n,6) + (1/2) P? - * 

(7.19) 

P2 1 1 (n # 0) = P^ 1/ _ 1 (n # 6) = (1/2) P^^ 1 (n,0) + (1/2) P2 x *_i< n * 0 ) 

(7.20) 

P 1 ? . (n+1) p" (n+1,9) (7.21) 

^3 Q 

where the summation is over all possible values of 8. 

Although both bits a n and a n+1 could be estimated in 
each interval, it is clear that only part of the second bit 
has been observed and thus a better estimation can be made 
in the next interval. Hence the optimum estimate of the 
first bit in the interval n < t < n+1 is determined by 
checking whether or not the following inequality holds. 

P 1 -l (n+1) + P l i^ n+1) < P -l,l^ n+1) + P -l,-l (n+1) (7.22) 

We decide a =1 was sent if the above inequality does hold; 
n 

if not, we decide a - -1. The nonlinear bit synchronizer 

n 

is shown in Figure 7.2. It is obtained by solving the 
filtering equation, (7.18), and by using the relation 
described by (7.22). Thus it represents a combined syn- 
chronizing and estimation scheme which . is optimum in the 
sense that it makes bit by bit decisions conditioned upon 
all observations up to that time. This technique can be 
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implemented with analog computers since the only nonlinear 
elements required are multipliers. 

C. Nonlinear Bit Synchronizer for Overlapping Signals 

For the overlapping signal case as shown in Figure 7.1(b) , 
the message and observation models are modified in order to 
set up a filtering equation. Let the observed symbol in 
the interval 

[ (n-1) - a + 0 , n + a + 0], n=l,2, ,N 

be s n (t) = a n S p (t) . (7.23) 

where S (t) is the overlapping symbol defined in Chapter III. 

P 

Using the same approach as Eq. (5.6), we again consider 
the following set of intervals, 

[n - (1/2), n + (1/2], n=l , 2 , . . . ,N . 


and define the following functions: 


S^\ (t, 6) 


a S (t-8-n) 
n p' 


a , S (t-l-0-n) 
L P 


for (n - .5) <_ t <_ (n+0+ct) 

(7.24) 

for (n+0-ct)< t < (n + .5) 


where 


n 


n+l ' 


n=l , 2 , 


t N 


The related waveform for a =1 and a . - -1 is indicated 

n n +1 

by Figure 7.3 in the interval (n - 1/2), (n + 1/2). We also 
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need to define the following probabilities: 



Fig. 7.3. 


S . 
1 j 

the 


and the signal waveform in 
interval (n - .5, n + .5) 


P i . (t,6) = Pr 


s n (t)-a n S p (t-6-n) , 


for (n - .5) < t < (n+8-ra) : 


a n (t)=a i.-S (t-6-n-l) , for (n+6-a) < t <_ (n + .5) 
n+l p 

(7.25) 


where a n i, a n+1 ^ j / a / 3 “ 1,-1. 

Then the observation model on the interval (n - .5, 
n + .5) can be written as follows 

y(t) = S^j(t,6) + dv/dt, (7 . 26 ) 

2 

where E (dv ) = B Q dt. 

Substituting (7.24) into (7.26), we have 

y(t) = { a R Sp ( t-0-n) + a n+1 S p (t-0-n-l) } + dv/dt 
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The filtering equation can be found as follows. 

a 

p"j <t,8) = L + P?.. (t , 8 ) + P^.. <t , e ) (y - m 6 (t) ) (S?. <t,8) 

-m 0 (t))/B o (7.27) 

where 

1 1 r 

m e (t) = E £ s“. (t,e) p" <t , e ) dt (7.2,) 

i=-l i=-l j J J 

— CO 

The bit synchronizer structure by solving (7.27) is 

shown in Figure 7.4. The received signal is passed through 

a transition detector to form the function S n .(t,6). The 

ID 

rest of the structure is similar to the synchronizer 
developed in Section B of this chapter. 

V. MISCELLANEOUS TOPICS 
A. False Lock Detection 

The split-phase waveform used in many telemetry systems 
has the advantage that it has zero average value, indepen- 
dent of data bit sequence, and very little low frequency 
content. Also, the split-phase waveform has a transition 
in the middle of every bit, which fact can be used to 
assist in detection and synchronization. 

With many types of synchronizers, however, it is 
possible to be in sync one-half bit out of phase on split- ' 
phase signals. In order to detect or synchronize split- 
phase data, it is usual to invert the sign of the integrator 



85 


at mid-bit to obtain the full plus one or minus one energy. 
A matched filter for false lock can be constructed by using 
an integrate and dump over the full bit. Since missed 
transitions occur with probability j for equiprobable and 
independent adjacent bits, the false-lock condition quickly 
becomes evident by the existence of missed transitions: 

The output is zero if there is a transition and plus or 
minus one if integrated over a missing transition. 

If y^ is the output of the missed transition detector 
for each bit, the likelihood ratio 

p (y I H 1 ) f - _ T 2Ty i H 

pT ypTr = "y?l + n-ppexp sr =°sh -g— J 

U 0 0 

where p^ is the probability of an end-of bit transition. 

For real data it is at least one half, since such data can 
contain many zeros. The actual detector is implemented 
by using a threshold on the posteriori probability of H . 

P (H 1 | y) p(v|H 1 ) p(H 1 ) 

P | y) “ P (y ! H q ) p(H Q ) 

p(H 1 ly) P (y|H 1 ) p(h 1 ) 

° r ln p(H 0 |y) = ln p(y|H 0 ) + ln 1 - p(H 1 ) 


The complete false lock detector is implemented by computing 


= + (l-p 1 ) 


_ T 2T Y; 

exp g- cosh — jj 
0 o 




+ log pOi^) 
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This statistic is quite sensitive to p^. However, if a 
conservative value of is used the detector can be 
successfully used. The configuration is 



The detector is ordinarily used with an up-down counter 
and limiter. This provides for a reasonably quick 
decision, but it may not detect false lock with data with 
appreciably greater than 1/2. 

B. Bit Synchronizer Evaluation Techniques 

It has been suggested that some useful and easily 
applied performance measure, or alternatively, a simple 
performance test, be applied to bit synchronizer-detectors. 
Peavey [14] has given results of testing on actual 
synchronizers with typical time-base error patterns. The 
performance was marked by mixed behavior with respect to 
various criteria. For example, one would perform better 
at low signal-to-noise rations, another at high, one would 
show better cycle slipping performance, one would be more 
resistant to worn part TBE, and so on. Under such con- 
ditions, testing becomes a very time consuming task, and 
specification and selection a most emotional matter. The 
problem can be narrowed down considerably by considering 
the following inputs to the selection of a metric: 






1. The mix of available data 

2 . Optimum synchronizer performance 

3. Data recovery capability 

The significant data characteristics for the satellite 
telemetry applications of this study are: 

1. Data rate 

2. Additive noise PSD 

3. Pulse shape before IF filtering 

4. IF filter characteristic 

5 . Frame length 

6 . Tape recorder TBE spectrum 

7. Receiver carrier tracking loop bandwidth 
and cycle slipping probability 

The first four characteristics relate to bit-rate phenomena 

and the last three to tracking rate. 

Synchronizer performance may be characterized by the 
following measures: 

1. Probability of bit error with additive noise and 
typical recorder time-base error 

2. Cycle slipping probability with additive noise and 
typical recorder time-base error 

3. Acquisition time with additive noise and typical 
recorder time-base error 

4. Probability of bad data acknowledgement under 
various circumstances 

In general, additive noise varies over quite a wide 
range in typical satellite applications. In contrast, 
recorder performance is not affected by orbital parameters, 
and thus once a suitable recorder model is obtained, it or 
two or three subclasses or recorder model, to account for 
various states of repair, are sufficient. The measures of 
synchronizer performance stated above are then primarily 



curves of performance criteria versus signal-to-noise ratio 
with recorder model as a parameter. This suggests a per- 
formance index based on two or three recorder models. 

Measures of data recovery capability are determined 
to a considerable extent by operational considerations. 

The range of signal-to-noise ratios encountered can usually 
be predicted from knowledge of the orbital parameters and 
the communication system data. In addition, user criteria 
are of interest. For example, many users do not care about 
occasional bad points, but they do require a knowledge of 
which data are invalid. Cycle slips in general cause a 
loss of either one or two frames of data, and thus a cycle 
slip should be weighted as heavily as a frame of bit errors 
As a result, the following measure of bit synchronizer 
merit is tentatively suggested: 

R 

max 

M = f P (E I R) + F Sli Pl R) W(R)dR, 

R J p opt (E l R) 

min 

Where R . and R are the minimum and maximum signal-to- 
min max 

noise rations to be expected in useful operation, R is the 
signal-to-noise ratio, F is the frame length, and W(R) is 
the operational requirement weighting function. If wide 
variations of recorder performance are to be expected in 
practice then a weighted average of M taken at several 
signal-to-noise ratios should be used. 
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An additional important consideration is that of 
recorded signal bandwidth. This criterion should depend 
on the mix of recorded signal bandwidths to be expected 
in practice. The test should be based on a signal with 
a fairly realistic but reasonably easily generated TBE 
pattern. One possibility is a flat flutter spectrum 
passed through a representative speed control filter with 
a representative worn part component at a worst case 
frequency. 



Conclusion 


The primary accomplishments of this study have been 
in the analysis and simulation of receivers and bit 
synchronizers. It has been discovered that tracking 
rate effects play a rather fundamental role in both 
receiver and synchronizer performance, but that data 
relating to recorder time-base-error (TBE) , for the 
proper characterization of this pehnomenon , is in rather 
short supply. 

It is possible to obtain operationally useful 
tape-recorder TBE data from high s ignal-to-noise ratio 
(SNR) tapes using synchronizers with relatively wide- 
band tracking loops. Low SNR tapes examined in the 
same .way would not be synchronizable . One of the aims 
of any future study in this area should be the develop- 
ment of effective methods for testing and evaluating 
existing synchronizers. For this type of testing a 
realistic TBE model is a necessity. Experimental data, 
taken from existing tapes for which statistical data 
such as that recorded at GSFC tape quality or tape 
evaluation laboratories is available, should be examin- 
ed in an effort to correctly define satellite on-board 
tape recorder data characteristics. The techniques 
developed in this report can then be applied to the 
optimization of bit synchronizer models. It is possible 



that considerable improvement can be made in synchronizer 
performance with such models. 

Additional topics of interest are receiver false 
lock, cycle slipping, and other unusual phenomena, which 
have been described to some extent in this and earlier 
reports and simulated during the study. 
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